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Abstract 

Evolutionary dynamics provides an iconic relationship — the periodic fre- 
quencies of a game is determined by the payoff-matrix of the game. This 
letter reports the first experimental evidence to confirm such a relationship 
in two populations random-matched 2x2 games with 12 different payoff- 
matrix parameters. 

We find, in the different parameters games, the observed periodic frequen- 
cies of cycles are different. Interesting is that, the experimental frequencies 
linear positive relates to the theoretical frequencies, significantly (larger than 
5 sigma). The theoretical frequencies are calculated explicitly from payoff- 
normalized replicator dynamics — one of the simplest evolutionary dynamics. 
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1. Introduction 



Cycle is a significant phenomenon in social evolution. Evolutionary game 
theory predicts cyclic behavior as well, but such behavior has rarely been 
confirmed clearly in experimental games 

Only quite recently, in a continuous time laboratory environment, Ca- 
son, Friedman and Hopkins (CFH, 2012 [3]) found clear persistent cycles 
in population state space with the method of cycle rotation indexes (CRI). 
After that, with the CRI method, we found that in a traditional setting 
Rock-Paper-Scissors (RPS) game, cycles also exist, persist and do not dis- 



sipate [24] . For all of the cycles detected in experiments, the directions of 
cycles meet evolutional dynamics very well. Therefore one can say, qual- 
itatively, cycles in experiments conform to the expectations of evolutional 
dynamics. 

Some interesting questions now appear. How the cycles change when 
the parameters of game is changed? Can cycles meet evolutionary dynam- 
ics quantitatively? 

To answer these questions, we recur to periodic frequency — an iconic 
observable in cyclic behaviors. Our motivation comes from both experimental 
economics and the evolutionary game theory. On one hand, the frequency of 
the cycles in experiment can be measured. On the other hand, the frequencies 
can be calculated with the dynamics equations. Then, the consistency of the 
two sides can be tested. 

Base on the 12 experiments of 2x2 garnet, we detect and confirm the 
existence, persistence of the cycles whose directions meet evolutionary dy- 
namics. Meanwhile, each game has its own frequency in the experiment due 
to its unique payoff matrix. Firstly, we find the empirical cyclic frequencies 
relates linearly to the theoretical frequencies significantly. The theoretical 
frequencies are calculated explicitly from the payoff-normalized replicator 
dynamical (PNRD) Q. 

The structure of this letter is as follow. In next section, we introduce 
the 12 games briefly, calculate the theoretical frequencies for each of the 12 
games from the PNRD equations and point out the testable hypothesis. In 
section 3, we test the hypothesis and report the results (1) the cycles do exist 
and persist in the 12 games; (2) there exists a positive correlation between 



2 The reasons of using the 12 experiments will be explained in section I2TT1 
3 The reasons of using this model will be explained in section [4721 
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the theoretical frequencies and the experimental frequencies; (3) the average 
radius of the cycles do not change along time as expected by PNRD. The 
last section includes discussion and summary. Mathematical and statistical 
appendixes comes at the end. 

2. Experiments, Eigenvalues and Testable Hypothesis 

2.1. The 12 two population 2x2 games 

We use the 12 experiments with a variety of parameters in an influential 
published literature Stationary Concepts for Experimental 2 x 2- Games by 



Selten and Chmura 16 



All the 12 experiments are of the traditional setting which has been widely 
used to investigate dynamical behaviors 0, 0, [kJ 16, 0]. Specifically, There 



are two four-person populations in each group of the games [16j . Each group 
play the game for 200 rounds. The strategy set for each player in the first 
population X is (Xi,X 2 ) and the second population Y is (Yi,Y 2 )- In each 
round, every subject plays the game against a opponent randomly picked 
from the other population. The payoff matrix for each game can be gener- 
alized as Fig. [1] where (%), i, j = 1,2 indicates the payoff for the players 
in the first (second) population. The game 1~6 (each consists of 12 groups) 
are constant sum games and the game 7~12 (each contains of 6 groups) are 
nonconstant sum games having the same Nash equilibriums with the game 
1~6 correspondingly. 

The advantage of such experimental settings can be elaborated as follows. 
(1) As emphasized by the original designers of the experiments, for all the 
game, (2) The 12 games each has a unique mixed strategy Nash equilibrium, 
all belong to the most fundamental classical evolutionary dynamics mod- 
els whose real part of the eigenvalues are and endless cycles are expected 
mathematically which we should show in section [2T2l (3) There are sufficient 
samples (12 different controlled parameters and 108 groups), so the robust- 
ness of the results could be expected. (4) The successive 200 rounds samples 
are long and fit to test the evolutionary behaviors. To the best our knowl- 
edge, in laboratory two-population 2x2 games in homogenous environment^, 
these 12 games are the longest in the experimental rounds, widest in the 



The same experimenter, the same software, same culture of subjects pool and same 
payment rule. 
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Figure 1: Payoff matrix of the 2x2 games. 



parameters setting and the largest in the involved subjects number. With 
these advantages, these 12 games are supposed to be representative and fit 
for our investigations for social dynamics. 

2.2. Theoretical frequencies of the 12 games 

An evolutionary dynamics model describes the dynamics properties of a 
system. To obtain a theoretical expectation of the frequency, we start from 
an almost the oldest and the simplest model in evolutionary 



PNRD 12 



game theory. If a social state is supposed to be at (x, y) in which x denotes 
the proportion of X± strategy used in the population X and y denotes the 
proportion of Y\ strategy used in the population Y . The velocity at (x, y), 



denoted as (x, y) [HI, [2l], 0, [l7| , can be expressed for PNRD 12 



as, 



x = U x 1 (U Xl -U x )x 
y = Uy 1 (U Yl -U Y )y 



(1) 
(2) 



in which U x (Uy) is the mean payoff of the population X (Y) and U Xl (U Yl ) is 
the payoff for the individual who uses the Xi (Yi) strategy in the population 
X (Y). According to the 2x2 payoff matrix in Fig. [TJ the inner equilibrium 
N point, denoted as (xn,Vn), can be obtained; Then around N, we can get 
the square of eigenvalues A expressed (see Appendix A. 1| and Table [T]) as 



A 



(an - a 2 i) (012 - ^22) (&11 - &12) {k 



21 



^22, 



(012 o 2 i - an a 22 ) (&21 &12 - hi ^22) 



Substituting each of the payoff matrix of the 12 games into Eq. 
all the A 2 are negative. Denoting the eigenvalues as A = a ± it 
has only pure imaginary part (/3) and the real part (a) is zero|j 



(3) 

©, we find 
, we have A 
Base on (3, 



5 Mathematically, j3 > 0. a presents the tendency of the cyclic amplitudes along time 
(the amplitudes of the cycles will become larger, persistent or smaller when a > 0, a = 
or a < 0). j3 indicates the frequency who is higher when /3 is larger. Periods of cycles are 
determined by the frequencies as 1//. 
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Table 1: Payoff matrices, equilibrium, eigenvalues and theoretical frequencies 
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the theoretical periodic frequency {ftheo) of a game can be calculated as 

f theo = /3/27T. (4) 

The ftheo are shown in Tabled] and will serve as the approximate theoretical 
expectations in Fig. [3] to compare with observed frequencies. 

2.3. Testable Hypothesis 



In stochastic adaptive dynamics processes, as emphasized by Young [26 
in the detailed balance condition, the transitions between any pair of the two 
states is symmetry. In this condition, no net transit could be found in the 
state space. On the contrary, if there exists asymmetry transits within states, 
the detailed balance symmetry is broken, then pattern of the net transit must 
emerge in the state space [22I, Q], Bjj, 23]. For cyclic games, a naive hypothesis 
is the net cycles can be captured by the evolutionary dynamics quantitatively. 

By counting the net cycles in experimental time sequences, in the 200 
rounds/session and 108 session and 12 games data, the theoretical predictions 
of the PNRD fall into following testable hypothesis. 

(1) The social state will move cyclically; Directions of the cycles are 
clockwise. 

(2) The experimental frequency (fexp) of the cycles is linear correlative to 
the theoretical frequency (ftheo)- fexp should be when ftheo is zero. 

(3) The the average radius of the cycles R should not change along time. 



6 The evaluations include two approximations [7]. (1) In dynamics model, the popula- 
tion size is assumed to be infinite, but we use this model in experimental games with finite 
population size. (2) Mathematically, the expansion requires the motion very close around 
the rest point (NE), but we use it in full state space. 
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Figure 2: Schematic diagram. Background lattice represents the 25 social states. The 
segment S is the Poincare section from the Nash Equilibrium (N, star) to down edge. 
The direction of the cycle surround the center N is predicted by PNRD. An example is 
illustrated in |Appendix A. 4 for all of the measurements throughout this letter. 



3. Hypothesis Tests 

3.1. Test method: trajectory, Poincare section and net cycles 

As mentioned, we use social state (x, y) to describes the aggregate be- 



havior in these games 14j. As illustrated in Fig. [2j there are altogether 25 
social states in a two-population society where each population contains of 
four persons in the games. For a certain round t, the social state must be 
one of the 25 points in Fig [21 Across rounds, the state (x,y) is supposed to 
keep transiting and form a stochastic-like trajectory 

Urn- 

To verify the cycles qualitatively, we recur to the CRI (Cycle Rotation In- 
dex) method [3]. To calculate CM, a segment (called as Poincare section 0, 
denoted as S, as shown in Fig. [2]) is set from Nash Equilibrium N of the 
game to the low edge of its own state space. Every transit-i across S can be 
denoted as Cj and be assigned as Ci—1 (-1) if the transit is counterclockwise 
(clockwise). Then the CRI denoted by 9 can be calculated as 



in which J^i^i is the net cycles (denoted as C| t ) and £\ |Cj| is the total 
transits across the Poincare section-^. The 9 indicate the existence of cycles 
when it does not equals to 0. Additionally, 9 > (9 < 0) indicates the 
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direction of cycles is counterclockwise (clockwise)Q We use the subscript 
(t ,ti) to denote the observation in time interval [io,£i]) like ^ t0itl . 

3.2. Existence, persistence and direction of the cycles 

To test the existence of the net cycles in the 12 games, we calculate the 
average value #1,200 f° r the 12 games as well as the standard error over the 
groups. The results are shown in Table [2J Using the 12 games as samples, 
we find the existence of cycles is significant (j9<0.000, d.f. =11, two tailed, 
t-test with H° : #i, 200 = 0). 



Table 2: CRI, frequency and radius of the net cycles in the 12 experiments 



game 


obs. 


#1,200 


s.e.| 


V 


/l,200 


s.e.f 


-Rl.100 


-Rl01,200 


diff 


V 


1 


12 


-0.072 


0.026 


0.004 


0.015 


0.005 


-0.044 


-0.023 


-0.022 


0.003 


2 


12 


-0.087 


0.031 


0.015 


0.021 


0.006 


-0.035 


-0.049 


0.014 


0.303 


3 


12 


-0.141 


0.044 


0.009 


0.014 


0.004 


-0.084 


-0.071 


-0.013 


0.749 


4 


12 


-0.129 


0.018 


0.003 


0.031 


0.005 


-0.045 


-0.047 


0.001 


0.920 


5 


11 


-0.258 


0.051 


0.003 


0.042 


0.006 


-0.079 


-0.100 


0.021 


0.168 


6 


12 


-0.262 


0.040 


0.002 


0.052 


0.007 


-0.083 


-0.065 


-0.018 


0.194 


7 


6 


-0.025 


0.013 


0.052 


0.005 


0.002 


-0.021 


-0.010 


-0.011 


0.610 


8 


6 


-0.108 


0.026 


0.035 


0.025 


0.007 


-0.039 


-0.073 


0.034 


0.129 


9 


6 


-0.083 


0.068 


0.292 


0.012 


0.006 


-0.034 


-0.027 


-0.007 


0.841 


10 


6 


-0.122 


0.033 


0.028 


0.034 


0.009 


-0.039 


-0.034 


-0.005 


0.505 


11 


6 


-0.273 


0.018 


0.028 


0.062 


0.006 


-0.069 


-0.081 


0.012 


0.263 


12 


6 


-0.222 


0.063 


0.028 


0.045 


0.012 


-0.062 


-0.053 


-0.009 


0.546 



frs.e.: standard error. %: Wilcoxon signcd-rank test, two-tailed. Obs.: number of groups 



To verify the persistence of cycles, we use Wilcoxon signed-rank test to 
compare the 12 game pairs values of the #1,100 an d #101,200- Results show 
the null hypothesis of Ho : #i,ioo=#ioi,2oo can not be rejected (p=0.388, two- 
tailed, d.f .=11). This means the persistence of net cycles is data supported. 

The empirical directions are clockwise statistically, because all #1,200 of 
the 12 games are negative (see Table [2]). This consists the PNRD predictions 
(as shown in Appendix A.2). 



3. 3. Experimental frequency vs theoretical frequency 

The experimental periodic frequency can be imaged as the time average 



cycles counted. Similar to Eq. fl5]) and references [H, Q, 23], we defined 



exp 



ti — 1 



(6) 



7 If we denote C + =J2c =1 1^1 ( @ = Ec =-i 1^1) *° P resen t the counterclockwise (or 
clockwise) transits' times.* The index 9 is (C+ - C~)/(C+ + C~) as CRI 0- 
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Round t ftheo 

Figure 3: (a) The average accumulated Cf t of each of the 12 games, (b) Periodic frequen- 
cies of cycles. The z-axis (y-axis) is the ftheo (fexp)- The black dots indicate the mean of 
each 12-group game (game 1~6) and the black holes of each 6-group game (game 7 ~ 12). 
The bar indicates the s.e. and the numbers present the game i.d.. The slope of the line is 
0.498 and the intercept is 0.002. 

Fig. [3] presents net cycles number of C\ t along time t (up to 200 rounds 
in experiments) for the 12 games respectively. It is clear that, the mean 
slope of Cf t over time of these games are different. Then the frequencies are 
different. The frequencies of the 12 games are calculated numerically and 
shown in Table |2j 

The relationship between the theoretical frequencies (ftheo) and experi- 
mental frequencies (fexp) of the 12 games is demonstrated in Fig. El This is 
the main result of this letter. 

Statistical results show that the coefficient of the linear regression over 
the 12 paired samples is 0.498±0.057. It indicates the positive correlation 
between theoretical frequencies and experimental frequencies is strongly sig- 
nificant (at 8.7a > 5a leveQ). 

In addition, the constant of the regression is 0.002±0.003 (p=0.799, two- 
tailed) and its 95%C.I. [-0.005 0.009] includes 0.000. This implicates no 
systematic deviation exist — f exp should be zero when f theo is zero. 

Results from the robustness testings replicate the relationships above (at 



8 Linear regression of proportional-weighted by the proportional samples of the groups 
in the game. No weighted regression results shows a >5 also. 
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cr>5 level when the center of the Poincare section set at the game mean or 
at the group mean. For more details, see Appendix A. 3 and Table lA~3l ) . 



3.4- Radius of the net cycles 

Whenever a transit-i crosses the Poincare section, the Euclidean distance 
(denoted as %i) of the crossing dot to the center N can be measured (see 



examples in Fig. [2] and Appendix A.4|_. Explicitly, for a given time interval 



[to,ti], the average radius of the cycleaj can be defined as 

~~ V [771 \') 

in which i (=1,2,3,...) denotes the i-ih time of the trajectory passing the 
Poincare section, Cj=l ( Cj=-1) if the transit is counterclockwise (clockwise); 
The sum covers all of the transits across the Poincare section. Results of 
#1,100 and #101,200 °f the 12 samples are shown in Table [2j All the R values 
of the 12 games are negative. This also indicates the net cycles are all 
clockwise. 

To evaluate the changing of the radius along time, we test the null hypoth- 
esis Hq \ #101,200 =#i,ioo- Using the 12 games as the 12 independent samples, 
we find Hq can not be rejected (p = 0.965, £-test,two-tailed, d.f.— 11). This 
indicate that the change of the radius along time, either becoming larger or 
smaller along time, is not supported by data. 

The robustness of this result is evaluated by changing the Poincare sec- 
tion^, results from the 12 games samples report also the radius are of time 
independence. As expected by the PNRD, these 12 variety parameters 2x2 
games are neutral (a = 0) instead of stable (a < 0, spiral in) or unstable 
(a > 0, spiral out). 

Till now, each of the three hypothesis in section 12.31 gains its supports 
from the data. 

4. Discussion 

In the 12 diverse 2x2 population games, we confirm the existence of the 
net cycles. The observed periodic frequencies of cycles are different in the 



9 This observable, as a vector, has the background like the moment of force or torque 
in classical mechanics in physics. 



-'For more details, see Table HOI and [Appendix A.3[ 
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12 games. Interesting, the experimental frequencies linear positive relates 
to the theoretical frequencies which are calculated explicitly from PNRD, 
significantly (> 5a). Robustness testing supports the results. 

4-1. Related works and notes 

The eigenvalues (A = a + i/3) in evolutionary dynamics have been used to 



bridge the experimental social behaviors and evolutionary game theory [11 
@, 0]. The periodic frequencies (related to j3) has also been discussed by 
CHF [7]. In the 12 games investigated in this letter, the imaginary parts f3 
serves as the controlled variable and a(=0) serves as the invariant variable, 
the testing for the periodic property is possible. 

On methodology view, these findings are benefitted from recently effort 
on experimental testing on evolutionary dynamics — transition spectrum 



method [25|, the C RI [7J| , the angular momentum method [20] and the ve 



locity field method [22J. Common point of these metrics is to capture the 
net transits who are of time asymmetry. In this letter, we mainly use the 
Poincare section method [zj]. For the net cycle counting, Poincare section 
methos is an approximation. The results of the cycles counting could be 
affected by where the Poincare sections are set. In more general conditions, 
how to test the dynamics behavior more efficiently might be a question. 

On observable view, as a novel experimental observable, periodic fre- 
quency can serve also as a testable variable for social dynamics behavior 
testing. This observable, which can be both theoretically calculated and ex- 
perimentally measured, could be a link between evolutionary game theory 
and experiments. 

4-2. Puzzles on the evolutionary dynamics models 

In the tens and still growing-up numbers of the evolutionary dynamics 



models |21|, [10|, llJ] , to capture the experimental frequencies, we firstly use 
PNRD — an almost the oldest and the simplest model. Mainly, we consider 
two aspects following. (1) Replicator dynamics is the simplest model. (2) 
The payoff values in the dynamics equations need to be normalized, because 
the time has been normalized by experimental discrete time rounds. Even 
though the significance of their linear relationship is up to 5cx and the constant 
of the regression closes 0, however, the theoretical frequencies from PNRD is 



11 



twice as much as the experimental frequencies. This is a crucial puzzla^l. 

Admittedly, we are not aware now which dynamics will perform better 
than PNRD among the tens dynamics models [2l|, ll4| or the learning mod- 
els ji[ . Nevertheless, the results in Fig. [3] provide a hind that evolutionary 
game theory can be expected be tested in laboratory experiments. 

4-3. Summary 

Using the 12 different parameters 2x2 games, besides confirm the ob- 
servations of the cycles in experimental games 0, we are interested to find 
the experimental periodic frequencies of the cycles are positively relative to 
the theoretical periodic frequencies significant (>5<r level). The theoreti- 
cal periodic frequencies are calculated from the payoff-normalized replicator 
dynamics — an almost the oldest and the simplest model. 



Appendix A. 

Appendix A.l. A Mathematical derivation for the eigenvalues 

To give a mathematical derivation of the eigenvalues, we start from the 
PNRD equation. The equations are specified by the 2x2 payoff matrix as 



Table [TJ Symbols in this section are elaborated in reference 15 



Suppose x (y) is the proportion of the first population using strategy X\ 
(Yi), it is natural that X%=1 — X\ and Y2—I — Y\. Then the average payoff 
for the four strategies can be expressed as the following matrix. 

/ U Xl \ ( «n y + 012 (1 - y) \ 

Ux 2 _ 021 y + a 22 (1 - y) 

U Yl fen x + 6 2 i (1 - x) 

\U Y2 J \ 612 x + b 22 (l-x) J 

where Uxt (UyJ, % = 1,2 is the payoff for a player in the first population 
choosing strategy Xi (Yi). Further, the average payoff for each population 
can be aggregated as, 



U x 

Uy 



xU x , +(l-x) U 



yU Yl + (l-y) U, 



X 2 
Y2 



11 It is crucial when comparing with the condition in general physics. For example, in an 
RCL-circuit, the theoretical resonant frequencies from the dynamics equations can predict 
the experimental frequency exactly. 
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According to the payoff-normalized replicator dynamics (PNRD) equa- 
tion [12|, we obtain the a system of ordinary differential equations (ODE) 

± = x(U Xl - U X )U X 1 
y = y(U Yl -U Y )Uy 1 . 

Specified for 2x2 games whose payoff matrix are shown as Fig. [H the ODE 
above can be presented as 

x(l - x) [(012 - 022) - (012 - Q22 + Q21 - an) y] , A 

X — r — r r (^A.IJ 

(an — 021 + a 2 2 — ai 2 )xy + (a\ 2 — a 22 )x + (a 2 i — a 22 )y + 022 

^ = yQ--y) [(&21 - ^22) - (&21 - ^22 + h2 - fen) x] 

(fen - 612 + b 2 2 - hi)xy + (621 - b 22 )y + (612 - ^22)2; + &22 

Apparently, there exists a unique inner Nash equilibrium N in the rectangular 
coordinate system constructed by x and y (0 < x, y < 1), which is 

^~^ 22 - , ) . (A.3) 

.021 - 022 + 012 - On a 12 - a 22 + a 2l - a n J 

Then surrounding the equilibrium point N, the Jacobian of Eq. ( 1A.1I) is 



q (feii-bi2)(&2i-fe22)(Qi2-Q22+a2i-aii) 2 
(an-a2i)(ai2-a22)(tei-b22+bi2-bii) 2 



2 



7_ [ (ai2H2i— ana22)(62i— 622+612— 611) 

I (an -a2i)(ai2-a22)(62i -622+612—61: ^ 2 
V (621 612 -611622 )(ai2-a22+ci2i -an) 

Then, the square of the eigenvalues of Jacobian is 

^2 _ (an - Q21) (012 - Q22) (fen - 612) (021 - ^22) ^ A ^ 

(a i2 a 2 i - an a 22 ) (&2i fei2 - fen b 22 ) 

which is the Eq.([3]) in main text. 

Substituting the payoff matrices of the 12 games into Eq.([3]) in main 
text, we find that their eigenvalues squared are all negative real numbers as 
A 2 column in Table [TJ Denoting A as a + i/3, one can notice that, the real 
part of the eigenvalue a equals and only the imaginary part left. 

This means the eigenvalues of the 12 games are the pure imaginary values, 
even though the values differ for each of the 12 games. Then, the theoretical 
periodic frequencies in Eq.(j2]) should be different for the 12 games. 

Appendix A. 2. Theoretical directions of the cycles 

We use PNRD equations to demonstrate the directions of the cycles of 
the 12 games respectively. All of the velocity vector fields are cyclic and 
clockwise as shown in Fig. IA.4I 
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Figure A. 4: PNRD expectation of the transit directions of the 12 games. 



Table A. 3: OLR results of f exp vs ftheo in various Poincare sections 



Poincare section 


fe x p 


Coef. 


Std.Err. 


i 


P > |*| 


[95%C./.] 


Nash 

equilibrium 


ftheo 
cons 


0.4983109 
0.0021428 


0.0572828 
0.0032894 


8.70 
0.65 


0.000 
0.529 


0.3706768 
-0.0051864 


0.6259450 
0.0094719 


Observed average of 
12(6) observations 


ftheo 
cons 


0.4110736 
0.0115081 


0.0762773 
0.0059308 


5.39 
1.94 


0.000 
0.081 


0.2411172 
-0.0017065 


0.5810299 
0.0247227 


Observed average of 
each group's observations 


ftheo 
cons 


0.390514 
0.0152928 


0.0691754 
0.0052301 


5.65 
2.92 


0.000 
0.015 


0.2363816 
0.0036395 


0.5446464 
0.0269461 



Table A. 4: Changing of R along time in various Poincare sections 





Game mean 


Session mean 


game 


obs . 


-Rl.100 


#101, 200 


V 


#1,100 


#101,200 


P 


1 


12 


0.043 


0.032 


0.315 


0.049 


0.027 


0.179 


2 


12 


0.027 


0.046 


0.151 


0.042 


0.052 


0.551 


3 


12 


0.034 


0.046 


0.452 


0.039 


0.061 


0.362 


4 


12 


0.071 


0.078 


0.786 


0.055 


0.074 


0.233 


5 


11 


0.09 


0.099 


0.576 


0.076 


0.091 


0.165 


6 


12 


0.075 


0.06 


0.324 


0.074 


0.06 


0.243 


7 


6 


0.032 


0.017 


0.594 


0.031 


0.014 


0.52 


8 


6 


0.042 


0.095 


0.063 


0.049 


0.077 


0.168 


9 


6 


0.03 


0.014 


0.534 


0.045 


0.033 


0.616 


10 


6 


0.038 


0.032 


0.579 


0.055 


0.045 


0.573 


11 


6 


0.064 


0.079 


0.301 


0.068 


0.072 


0.83 


12 


6 


0.051 


0.05 


0.914 


0.056 


0.056 


0.992 
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Appendix A. 3. Robustness testing on changing Poincare section 

The Poincare section method suggested by CFH [7| is efficient for net 
cycles detection. However, where the Poincare section should be set is a 
puzzle. Because it is not clear where the center of cycles is in the stochastic 
trajectory and different learning models provides different centers 16, I|. So, 
the robustness of above results need to be tested. 

To test the robustness of the results on frequencies and radius of cycles, 
we use three various settings of Poincare section center (1) Nash equilibrium 
(reported in the main text), (2) observed average of observations of each the 
12 games and (3) observed average of observations of each of the 108 groups, 
respectively. 

On the relationships of f exp the ftheo - ~ The regression results are ex- 
hibited in Table IA.3I The positive correlation relationship between f exp and 
ftheo are established in all three situations. Additional testings show that 
the positive correlation relationships are significant (at <j>5 level with 0- 
constant). The ordinary linear regression are proportional- weighted by the 
number of groups of the games. Such results state clearly that the rela- 
tionship between experimental periodic frequencies and theoretical periodic 
frequencies do not dependent on the Poincare section selecting. Meanwhile, 
the results also announce that the Nash equilibrium performs better than 
the other two situations. 

On the changing of the cycle radius R - The -Ri,ioo and -Rioi,2oo of 
each game (and also the results of paired sample t-test over each groups) are 
exhibited in Table IA.4I R is not changing when the Poincare section center is 
changed to game mean center (p=0.473, t-test, two-tails, d.f =11) or group 
mean center (p=0.7018, t-test, two-tails, d.f .=11). 

Appendix A. 4- An example of the measurements 

In the 12 experiments, each group play the game for 200 rounds, so the 
trajectory has 200 nodes in state space and 199 transits are observed. To 
make the concepts used in this letter easier to understand, we suppose an 
"experimental observed" chronological stochastic trajectory to demonstrate 
the concepts and the measurements. 

In the example, the Poincare section begins from (0.3636,0.5873) in the 
state space as Fig. [2] in main text illustrates. The hypothetical trajectory 
has 4 transits (transit-1, transit-2, transit-3 and transit-4) and the order of 
1— >2— >...— >5. The time interval is [1,5]. 
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Specifically, on this "experimental observed" trajectory, the social state 
of 3rd round is at (|, |), which means 2 (1) subjects use X x (Y"x) and 2 (3) 
subjects use X 2 (Y 2 ) in population X (Y) respectively. 

From 1st to 2nd round, the transit-1 passes the S and its Ci-value in 
Eq. (jSj) is -1 and Xi-value in Eq (j7]) is 0.549; From 2nd to 3rd round, the 
transit-2 passes the S. Its C 2 -value in Eq. (jSJ) is 1 and x 2 -value in Eq. (j7|) is 
0.474. 

According to Eq. (jSJ), CRI (Cycle Rotation Index) #i j5 is -0.333. 

According to Eq. fl6]), the frequency f exp is 0.250. 

According to Eq. flTJ), the radius of the "net cycles" [Ri^) is -0.115. 
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